ON ALGEBRAIC RICCATI EQUATIONS ASSOCIATED WITH 

M-MATRICES 



CHUN-HUA GUO 



Abstract. We consider the algebraic Riccati equation for which the four co- 
efficient matrices form an M-matrix K. When is a nonsingular Af-matrix 
or an irreducible singular M-matrix, the Riccati equation is known to have 
a minimal nonnegative solution and several efficient methods are available to 
find this solution. In this paper we are mainly interested in the case where K 
is a reducible singular M-matrix. Under a regularity assumption on the M- 
matrix K, we show that the Riccati equation still has a minimal nonnegative 
solution. We also study the properties of this particular solution and explain 
how the solution can be found by existing methods. 



1. Introduction 
We consider the algebraic Riccati equation 
(1) XCX - XD - AX + B = 0, 

where A, B,C, D are real matrices of sizes m x m,m x n,n x m,n x n, respectively, 
and 

D -C 
-B A 



(2) K 



is an M-matrix. 

For any matrices A, B € W^'^'', we write A> B {A> B) if aij > 6ij(ay > bij) for 
all A real square matrix A is called a Z-matrix if all its off-diagonal elements 
are nonpositive. Note that any Z-matrix A can be written as si ~- B with B > 0. 
A .Z-matrix A is called an M-matrix if s > p{B), where p(-) is the spectral radius; 
it is a singular Af -matrix if s = p{B) and a nonsingular M-matrix if s > p{B). 

If K is an arbitrary A/-matrix, then the equation ([1]) may not have a solution. 
A simple example is the reducible singular M-matrix 



-1 



(3) K = 



for which the corresponding scalar equation ^ does not have any solutions. 

It is proved in TIT that the equation ([l} always has a minimal nonnegative 
solution if iiT in (l2|) is a nonsingular M-matrix or an irreducible singular M-matrix. 
This assumption on the matrix K has now become a standard assumption. In [23] , 
the equation ([T]) with K being a nonsingular Af-matrix or an irreducible singular 
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M-matrix is formally called an AZ-matrix algebraic Riccati equation. The case 
where K is a, reducible singular Af-matrix has never been studied, due to some 
technical difSculties associated with it. However, this case is of both theoretical 
and practical interest. The most important application of the Riccati equation 
(U)) is in the study of Markov chains [20 , where K ^ —Q and Q is the generator 
of a Markov chain. So all diagonal entries of Q are nonpositive, all off-diagonal 
entries of Q are nonnegative, and every row sum of Q is nonpositve. In this case, 
K is an Af-matrix with Ke > 0, where e is the vector of ones. Of particular 
interest is the case where if is a singular Af-matrix with Ke = 0. In the study of 
Markov chains, the irreducibility of Q is often assumed since Q is irreducible for 
most interesting Markov chains. But it is still desirable to have results available 
when Q happens to be reducible. In general, even if K is an irreducible singular 
AZ-matrix, it may still be close to some reducible singular Af-matrix. If we run into 
difficulties for a reducible singular Af-matrix, we would also run into difficulties for 
nearby irreducible singular Af-matrices. It is therefore of importance to study the 
case where K is a, reducible singular Af-matrix. 

2. Existence of a minimal nonnegative solution 

As we have seen earlier, the equation ([ij may not have a solution for an arbitrary 
Af-matrix K. So to guarantee the existence of a solution we still need to add some 
assumption on K. The assumption we need is that Kv > for some vector v > 0. 
Note that this assumption is always satisfied if K is from the study of Markov 
chains, as we mentioned above, whether it is reducible or not. We also note that 
the so-called Af -splittings of a reducible singular Af-matrix have been studied in 
pi] , where this same assumption on the singular Af-matrix also plays an important 
role. 

For convenience, we introduce the following definition. 
Definition 1. An M-matrix A is said to be regular if Av > for some v > 0. 

It is well known [2 that for any nonsingular Af-matrix A there is a vector 
?; > such that Av > and that for any irreducible singular Af-matrix A there 
is a vector u > such that Av = 0. Therefore, nonsingular Af-matrices and 
irreducible singular Af-matrices are always regular Af-matrices. It is easily seen 
that the reducible singular Af-matrix in ^ is not a regular Af-matrix. Note that 
any Z-matrix A such that Av > for some u > is an Af-matrix [2 and hence a 
regular Af-matrix by definition. Note also that any principal submatrix of a regular 
Af-matrix is still a regular Af-matrix. 

We are going to prove that the equation ([1} has a minimal nonnegative solution 
whenever K is a. regular Af-matrix. We start with the following result. 

Lemma 1. Suppose that the matrix K in ^ is a regular AI -matrix and all diagonal 
entries of A are positive. Then ([T} has a nonnegative solution $ such that D — C$ 
is a regular AI -matrix. Moreover, ^ < X for any nonnegative solution of the 
inequality Ti-{X) < 0, where 

n(X) = XCX - XD - AX + B. 

In particular, $ is the minimal nonnegative solution of the equation ([T]) . 
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Proof. The proof is an adaptation of the proof of [101 Theorem 3.1]. We write 
A = Ai- A2 and D = Di - D2, where Ai = diag (A) and Di = diag (D). We take 
Xq — and use the fixed-point iteration: 



(4) 



AiX, 



i+l 



X,+iDi - X,CX, + X,D2 + A2X, + B, 



0,1, 



The iteration is well defined since the diagonal entries of D are nonnegative and the 
diagonal entries of A are assumed to be positive. It is easily shown by induction 
that Xi < Xij^i for any i > 0. 

Since K \s a. regular M- matrix, we have Kv > for some v > 0. Write v = 
[vf vl^Y with vi e R" and G K™- Then we have 



(5) 



DiVi — D2V1 — Cv2 > 0, A1V2 — A2V2 — Bvi > 0. 



We now show that XkVi < V2 for all fc > 0. The inequality is trivial for k = 0. 
Assume that XiVi < W2 (« > 0). Then, by ^ and (O, 

AiX,+iVi + X^+iDiVi = X.CX^vi + X,D2Vi + A2X,vi + Bvi 

< X,Cv2 + X,D2Vi + A2V2 + Bvi 

< X,DiVi+AiV2. 

It follows that AiXi+iVi < A1V2 + {Xi — Xi+i)DiVi < AiV2- So X^+iWi < V2- 
Thus, we have proved by induction that XkVi < V2 for all fc > 0. Now, the 
sequence {Xi} is monotonically increasing and bounded above, and hence has a 
limit. Let $ — limi_^oo Xi. Then $ is a nonnegative solution of ([T]) by We also 
have < V2 and then {D-C^)vi > Dvi-Cv2 > 0. Thus, the Z-matrix - C$ 
is a regular M-matrix. We now let X be any nonnegative solution of TZ{X) < 
and re-examine the iteration (g]). Since XCX + XD2 + A2X + B < AiX + XDi 
by Tl{X) < 0, it is easily shown by induction that Xi < X for any i > 0. It follows 
that $ < X. In particular, $ is the minimal nonnegative solution of ([T]). □ 

Theorem 2. // the matrix K in ^ is a regular AI -matrix then ([ij has a minimal 
nonnegative solution $ and D — (7$ is a regular M-matrix. 

Proof. If all diagonal entries of A are positive, the result is already proved. Suppose 
that r diagonal entries of A are 0. Then the r rows of K containing these diagonal 
entries must be zero rows since X is a regular M-matrix. If r = m, then A — 
and -6 = 0, and the equation ([1]) has a minimal nonnegative solution $ = and 
D — C$ is a regular Af -matrix. So we assume 1 < r < m. Then, there is an m x m 
permutation matrix P such that 



PAP^ = 



(HI is equivalent to 





■ A 


A ' 














X (m — 


r), i? is 



PB = 



B 




CP' = 



c c 



(PX){CP^)(PX) - (PX)B - {PAP^)(PX) + PB = 0. 



Let 



PX 



X 
X 
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where X is {m — r) x n. Then 
(6) 



X 








X 




X 


D - 


' A 


A ' 




X 




' B ' 






c c 

















+ 


X 






X 




X 









X 








We now take X ~ 0. Then the above equation reduces to 
(7) XCX - XD - AX + B = 0. 

Since the matrix 



(8) K = 

is a principal submatrix of the regular M-matrix 



-B 



-C 
A 



' In 







D 


-c ■ 




■ /„ 








P 




-B 


A 







p 



it is also a regular Af-matrix. Since all diagonal entries of A are positive, we know 
from Lemma [T] that the equation ([7]) has a minimal nonnegative solution $ and 
D — C$ is a regular Af -matrix. The solution 



(9) 







of ([TJ is then the only candidate for the minimal nonnegative solution. To confirm 
that a minimal nonnegative solution exists, we let 



P' 



X 
X 



be any nonnegative solution of ([T]). Then we have by ([6]) that 
XCX + XCX XD - AX - AX + B = 0. 

Thus 

XCX - XD - AX + B = -XCX + AX<0. 

It follows from Lemma [I] that ^ < X. Thus the matrix $ in © is indeed the 
minimal nonnegative solution of Note that D - C$ ^ D - (CP^)(P<i>) = 
D — C$ is a regular Af -matrix. 

Associated with the matrix K m ^ is the matrix 



□ 



(10) H 
The next factorization result follows from Theorem [2] easily. 

Corollary 3. // the matrix K in ^ is a regular M-matrix, then there exist non- 
negative matrices $ and 'J such that 



' In 







■ D 


-C ' 







K = 


B 


-A 



' D 


-C ' 




■ In 






'In ' 




' R " 


B 


-A 










* Im 




-s _ 



(11) 



where R = D — (7$ and S = A — B^! are regular M -matrices. 
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Proof. By Theorem [21 ([T]) has a minimal nonnegative solution $ and D — is & 
regular M-matrix. Thus 



(12) 



" D 


-C ' 




■ /„ ■ 




■ /„ " 


B 


-A 




$ 







R. 



for R = D — C<I>. Since X is a regular M-matrix, we have Kv > for some 
V = [vf vl^Y > 0, where vi G M" and G K™. Then 



K 



A -B 
-C D 



is a Z-matrix such that 



K 



V2 
Vl 



> 0. 



So K is also a regular M-matrix. Theorem [2] implies that the dual equation of ([T]) 
(13) YBY -YA - DY + C = 

has a minimal nonnegative solution such that A — B^ is a regular M-matrix. 
Thus 



(14) 



" D 


-C ' 










B 


-A 











i-s) 



for S = A - B*. The factorization ((TTl) is obtained by combining and (HH). □ 

3. Properties of the minimal nonnegative solution 

We assume that the matrix iiT in ([2]) is a regular Af-matrix. So the equation ([T]) 
has a minimal nonnegative solution $ and Z? — C$ is a regular A/- matrix, and the 
dual equation ()13|) has a minimal nonnegative solution ^I^ and A — _B5' is a regular 
M-matrix. In this section we prove some additional properties of $ and 5*. 

Proposition 4. Suppose that K is a regular M-matrix and Kv > for v = 



U2] > 0, where vi G M" and V2 G 



Then $ui < V2 and ^t;2 < Wi • 



Moreover, /,„ — $5* arte? /„ — ^$ are 6ot/i regular AI -matrices. 

Proof. If A has no zero diagonal entries, we already know from the proof of Lemma 
[1] that < V2. Suppose that r diagonal entries of A are 0. If r = m, then 
A = and B — 0. In this case, $ = and $wi < V2 is trivial. So we assume 

1 < r < m and use the notations in the proof of Theorem [2l Let Pv2 = 



where V2 G M™^*". Then the matrix K in ^ satisfies K 
< V2. Then 



^vi = P^ 







Vl < P^ 



V2 





< P' 



Vl 
V2 



V2 
V2 



V2 



> 0. It follows that 



V2- 



By applying the result $wi < V2 to the dual equation (fT3| . we get ^'U2 < ui. We 
then have $\E'U2 < $wi < V2 and thus (/„ — $^')u2 > 0. So Im — is a regular 
M-matrix. Similarly, /„ — is a regular A/-matrix. □ 
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Note that the relation in (fTTj) does not always give a similarity transformation 
since the matrix 

" /„ * 



(15) 



may be singular. The matrix (llSp is nonsingular if and only if the Af-matrix /„ 
is nonsingular, i.e., if and only if p{^'i') < 1. 

We denote by C<, C<, C>, and C> the open left half plane, the closed left half 
plane, the open right half plane, and the closed right half plane, respectively. We 
have the following information about the eigenvalues of H even if the matrix (fT5|) 
is singular. 

Lemma 5. For any M -matrix K , the matrix H in (jlOp has mi(< m) eigenvalues 
in C<, ni{< n) eigenvalues in C>, and r — (m — mi) + (n — ni) zero eigenvalues. 

Proof. For any e > 0, — K + elm+n is a nonsingular M-matrix. Thus (see [10]) 

D + e/„ -C 
B -{A + el^) 

has m eigenvalues in C< and n eigenvalues in C>. The result follows by letting 
e — !> 0^ since eigenvalues are continuous functions of e. □ 



Since 
(16) 



H 



' In ' 






X 




X 



{D - CX) 



for any solution X of ([T]), the column space of 



X 



is an invariant subspace of 



space of 



H corresponding to n of its eigenvalues. For the minimal nonnegative solution $ of 
([ij (when if in ([2]) is a regular Af-matrix), £> — (7$ is an Af-matrix and thus all its 
eigenvalues are in C>. When H has exactly n eigenvalues in C>, the column space 

of must be the invariant subspace of H corresponding to these eigenvalues. 

When H has more than n eigenvalues in C> , the next result shows that the column 

is an invariant subspace of H corresponding to its n eigenvalues 

with the largest real parts. 

Theorem 6. Assume that the matrix K in ^ is a regular M-matrix. Let all 
eigenvlaues of H in ()10|) be arranged in an descending order by their real parts, 
and be denoted by Ai, . . . , A„, A„+i, . . . , A„+m. Then the eigenvalues of D ~ C$ are 
Ai, . . . , A„ and the eigenvalues of A ~ i?^ are — A„+i, . . . , — A„_|_„j. In particular, 
A„ and A„+i are real numbers. 

Proof. For any e > 0, let if^ and be as in the proof of Lemma [5] Then the 
equation ([IJ corresponding to K^^ has a minimal nonnegative solution $e and the 
eigenvalues oi D -\- ein — C^e are the n eigenvalues of TJe in C>. Since K is a 
regular Af-matrix, Kv > for some v > partitioned as in Proposition 21 Then 
we have K^v > and < U2- So the set {$e} is bounded and thus there is a 
sequence {efe} with limfc_).oo ffc = such that limfe^oo = ^ exists. It is clear 
that $ is a nonnegative solution of the equation ([T]) (corresponding to the matrix 
K) and that the eigenvalues oi D — (7$ are Ai, . . . , A„. Since $ < $, we have 
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trace(-D — (7$) > trace(Z? — C$). However, the trace of a matrix is equal to the 
sum of its eigenvalues. It follows that the eigenvalues of D — (7$ are Ai, . . . , A„. 
By applying this result to the dual equation (jl3|) . we know that the eigenvalues of 
A — B"^ are — A„+i, . . . , — A„+m- The eigenvalues A„ and A„+i are real numbers 
because for any M-matrix the eigenvalue with smallest real part must be a real 
number. □ 

Corollary 7. Let K and H he as in Theorem\^ Then the eigenvalues of A~^C are 
— A„+i, . . . , —Xn+m o,nd the eigenvalues of D — Vl/i? are Ai, . . . , A„. In particular, 
D — is nonsingular if and only if D — C$ is nonsingular, and A — $C is 
nonsingular if and only if A — B^! is nonsingular. 

Proof. Since $ is a solution of ([I]), it is easily verified (and is well known) that 



(17) 



" /„ ■ 


-1 

H 


'In ■ 




' D-C<P 


. * ^™ . 


. $ /m . 








-c 

-(^-$C) 



-A, 



By this similarity transformation, the eigenvalues of A — <I>C are A^^^i, . . . , /\n+m 
in view of Theorem [S] Applying this result to the dual equation (|13p. we know that 
the eigenvalues of D — ^B are Ai, . . . , A„. □ 

When if in ([2]) is an irreducible singular M-matrix, the minimal nonnegative 
solutions $ and 5* are positive [11] and the matrix H has a simple zero eigenvalue 
except for a critical case where H has a double zero eigenvalue with only one linearly 
independent eigenvector [TO] . Our emphasis in this paper is on regular M-matrices 
that are singular and reducible. We now assume that H has only one linearly 
independent eigenvector corresponding to the zero eigenvalue of multiplicity r > 1. 
Without this assumption, the minimal nonnegative solution of (|T]) may not be a 
continuous function of K on the set of regular Af -matrices. A trivial example for 
m = n = 1 is given by 



K 



The minimal nonnegative solution corresponding to K is 0, but the minimal non- 
negative solution corresponding to is 1 for any e > 0. A less trivial example for 
TO = n = 2 is 



" 


■ 




e —e 








— e e 



K = 



1 


-1 




-1 


1 





1 


-1 





e 


— e 



The minimal nonnegative solution corresponding to K is 



-1 

1 


L 

3 





— e 

e 



but the minimal 



nonnegative solution corresponding to is 



for any e > 0. 



For the rest of this section, we assume that H has only one linearly independent 
eigenvector corresponding to the zero eigenvalue. In other words, we assume that 
the null space of H is one-dimensional. In view of the relation ([TO]) . the null spaces 
of K and are then both one-dimensional. Note that K can have at most one 
zero diagonal entry under this assumption. By the Perron-Frobenius theorem [2], 
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there are nonnegative nonzero vectors 
U2,V2 S M™, such that 



Ui 


and 


Vl 


_ U2 







where ui,Vi € R" and 



(18) 



K 



V2 



0, [u^ ul]K = 0. 



They are each unique up to a scalar multiple, in view of our assumption on the null 
spaces. 

Lemma 8. Let ui,U2,Vi,V2 be as in (|18p . Then ujvi ^ u^U2 if and only if zero 
is a simple eigenvalue of H . 

Proof. Let P be a nonsingular matrix such that 

J 
W 



(19) 



H ^ P 



P-\ 



where J is the r x r Jordan block associated with the zero eigenvalue and W is 
nonsingular. It follows from pUj) and (|18p that 



(20) 



Vl 
V2 



0. 



Let Ci be the ith column of the identity matrix Im+n- Then by and (|20p 



(21) 



Vl 
V2 



«2ei, 



where ki and A:2 are nonzero constants. Multiplying the two equations in (|21l) gives 
ul"?;! — u>^V2 = kik2ejei. Thus wf'i'i 7^ u|'t;2 if and only if r = 1. □ 

We now assume that the singular Af -matrix K is regular. Then we have w > 
such that Kw > 0, but we do not necessarily have Kv = for some t; > 0. A 
simple example is 

[10 

K= 1 -1 
-1 1 

So the vectors ui,U2,vi,V2 in (jlSp are nonnegative, but not necessarily positive. 
However, we still have the following result. 

Lemma 9. Let K be a regular singular M -matrix, and let Ui,U2,Vi,V2 be as in 
(fT8| . Then $ui < V2, ^V2 < Vi, uf'^ < uj , * < lif". 

Proof. If A has no zero diagonal entries, we re-examine the proof of Lemma [T] and 
find that we still have XiVi < V2 for all i > 0, for the new vectors vi and V2 here. 
Since limi^oo -'^i = ^ was proved there, we have < V2. When A has zero 
diagonal entries, we can still show that < V2 using the procedure in the proof 
of Proposition m 

By taking transpose on the equation ([T]), we know that is the minimal non- 
negative solution of the equation 

(22) ZC^Z - ZA^ - D^Z + = 0, 

and for the corresponding singular A/-matrix 

A^ -C^ 



K = 
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we have K 



U2 

Ui 



= by p^ . If K were a regular Af-matrix, we could apply the 
result <^vi < V2 to the equation ( 
not always regular when K is, as seen from K = 



To prove $ U2 < ui, 



to get ^^U2 < Ml, or < uf . However, K is 
"0 " 
-1 1 

we first assume that D has no zero diagonal entries and proceed as in the proof 
of Lemma [TJ Let Ai, A2, Di, D2 be as given there. Let Zq = and consider the 
fixed-point iteration 

DiZ,+i + Z,+iAi = Z,C^Z, + Z,Al + DlZ, + B^. 

It is easily shown by induction that Zi < Zi+i < for all z > 0. It follows that 
limi_>.oo Zi = exists and is a nonnegative solution of (1221) . Since Z,, < and 
is the minimal nonnegative solution, we have = . As in the proof of 
Lemma [TJ we have ZiU2 < ui for all i > 0. Thus ^^U2 < wi- When D has zero 
diagonal entries, we can still show that $"^U2 < ui using the procedure in the proof 
of Proposition 

By applying the results < V2 and u^^ < to the dual equation (fT3|) . we 
have '^V2 < fi and m^^* < uJ. □ 



Theorem 10. Let K be a regular singular M -matrix and let ui,M2, Vi,i'2 be as in 
([T5|. Then 

(i) // ufvi > U2V2, then D ^ is singular and A — <I>C is nonsingular, 

<^Vi = V2, ^V2 ^ Vi, = U2, ^ uf. 

(ii) // ufvi < U2V2, then D — is nonsingular and A 



^Vi ^ V2, '9V2 = Vi, ^ U2, U2^ 

T 

^V2 = Vi, M^f^' 



<I>C is singular, 



(iii) If ufvi — U2V2, then D — (7$ and A — $(7 are both singular, $wi — V2, 



4,u'2<^ 



Proof. Rewriting ITT)) as 



H 



In 

Im. 



D^C^ -C 

-(A-$C) 



/« 



and using (|20|. we get 

(23) (uf -u^$)(2?-C$) = 0, 



(^-$C)($wi -'V2) = 0. 



For the dual equation (|13p. we have the corresponding result 

(24) (Mj-uf*)(A-S*) = 0, (i:)-1'S)(1'i;2-ui) =0. 

If D — is nonsingular, then uf = U2^ by ([23|l and ujvi = u|"<I>ui < U2V2 by 



LemmaO If ^ — 55' is nonsingular, then = uj'i' by and u|"w2 — uf'^V2 < 
i;i by Lemma m 

We now prove (i). When ufvi > u^V2, D — C$ is singular, and then A ~ 
and A — B'^ are nonsingular by Lemma 13 Theorem [6] and Corollary [71 It 
follows from (|23|) and (|24|) that $^1 = W2 and 5" = U2 ■ We now show that 
5'W2 ^ wi- This is trivial when V2 = 0. Suppose W2 7^ and 5't;2 = vi. Then 
{A — B'i/)v2 = Av2 — Bvi = 0, contradictory to the nonsingularity of ^ — B"^ . 
Finally, u"^^ 7^ is trivial when U2 = 0. Suppose M2 7^ and = . Then 
u^{A — $C) = —ufC + u^A = 0, contradictory to the nonsingularity of A — <I>C. 

The results in (ii) are obtained by applying the results in (i) to the dual equation 
(fT3| and using Corollary [71 
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To prove (iii), we consider (as in [14] ) 

K{a) = 



D -C 
-aB aA 



for a > 1. It is clear that K{a) is still a regular singular M- matrix, and the null 
spaces of K{a) and K{aY' are still one-dimensional. We now have 

wi(q!) = ui, U2{a) ^ a^^U2, vi{a) ^ vi, V2{a) ^ V2- 

So we have ui{aY' vi{a) > U2{a)'^V2{a). Let $(a) and '^{a) be the minimal non- 
negative solutions of equations (dJ and ([T^ . respectively, corresponding to K{a). 
We have by (i) that D — C$(a) is singular, $(a)wi = V2, w['^{a) = a~^u^ . Using 
the notation in Lemma [Sj H has mi eigenvalues in C<, ni eigenvalues in C>, and 
r zero eigenvalues. By our assumption, H has one r x r Jordan block associated 
with the zero eigenvalue. Let 

D -C 
aB -a A 



H{a) = 



For any a > 1 sufficiently close to 1, m — mi zero eigenvalues of H are perturbed 
to eigenvalues of H{a) in C< and the real parts of these m — mi eigenvalues of 
H{a) are strictly larger than those of the remaining mi eigenvalues of H(a) in C<; 
n — ni zero eigenvalues of H are perturbed to eigenvalues of H{a) in C>, and the 
real parts of these n — ni eigenvalues of H{a) are strictly smaller than those of 
the remaining ni eigenvalues of H{a) in C>. By using the perturbation theory in 
section 16.5 of [8 and section 5 of [9], we can modify the arguments leading to [Ml 
Theorem 3.3] to obtain that 

||$(a) - $11 < c\\K{a) - K\\^^\ ||*(a) - *|| < c\\K{a) - 

for some constant c > 0. We note that we only need to adapt the arguments for 
case (a) in [T3], which are valid also when K{a) is singular. The arguments for case 
(b) in [T4^ are to obtain stronger statements that are not needed here. We now 
have 

lim $(a) = $, lim ^[/(a) = vji. 

Letting a — > 1+ in our conclusions about $(a) and ^(a), we obtain that D — (7$ 
is singular, $wi — V2, uf'i> — . The other results in (iii) follows by duality. □ 

Corollary 11. Let K be a regular singular AI -matrix and let Ui, U2, wi, W2 be as in 
psp . If ujvi — U2V2, then /.,„ — $5* and /„ — are regular singular AI -matrices. 

Proof. By Proposition^ 7™—$^ and /„ — 5*$ are regular Af-matrices. By Theorem 
[TOl $^U2 = $vi = V2 and = — vi. So vi and V2 are both nonzero 

vectors, and 1 is an eigenvalue of $4' and 4'$. Thus — and /„ — ^$ are 
both singular. □ 

We also have the following conjecture. 

Conjecture 12. Let K be a regular singular Kl-matrix and let Ui,U2,Wi,U2 be as 
in (jlSp . If ujvi ^ ujv2, then — $^1/ and /„ — are nonsingular M -matrices. 

The conjecture is known to be true when K is irreducible [15] . Attempts to 
find counterexamples for the reducible case have failed and we are led to believe 
that the conjecture is true. But at present we can prove it only under a positivity 
assumption. 
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Proposition 13. Let K be a regular singular M -matrix. Then Im — and 
In — are nonsingular M -matrices if ujvi 7^ U2V2 and at least one of $ and ^ 
is positive. 

Proof. Assume ujvi > u^V2- If $ > 0, we know from Lemma [9] and Theorem 
[10] that $5'W2 < = V2. If ^ > 0, we know from Lemma [9] and Theorem [TOl 
that < ufvj/ = In either case we have p{^'^) = ^(^1'$) < 1 (see [21). 

So Im — and /„ — 5'$ are nonsingular M-matrices. The result for the case 
u'[vi < ujv2 follows by duality. □ 

As we mentioned earlier, $ and are always positive when K is irreducible. 
When K is reducible, they may still be positive. We also have the following related 
result. 

Proposition 14. Let K be a regular M -matrix. Then the equation ([T]) can have 
at most two positive solutions if the eigenvalues of H are all simple. 

Proof. Let w > be such that Kw > 0, and let = K euFwI — ewuF . Then 
Kf^vj = Kw > 0. So is an irreducible M-matrix for any e > 0. Suppose that 
the equation ([ij (corresponding to K) has more than two positive solutions. Then 
each of these solutions is determined by n eigenvectors of H corresponding to n of 
its simple eigenvalues. So each solution changes continuous as K is perturbed to 
K^. It then follows that the equation ([IJ corresponding to would have more 
than two positive solutions for e > sufficiently small, which is contradictory to [H 
Theorem 2.13]. □ 

4. Numerical methods for the minimal nonnegative solution 

When the matrix if in ([2]) is a nonsingular A/-matrix or an irreducible singular 
M-matrix, various numerical methods are available to find the minimal nonnegative 
solution of the equation (J]). See [D |1 11 [3 [71 [TUl [II [11 [II [11 [13 [T71 [11 [11 [13] . In 
this section we assume that if is a regular M-matrix that is singular and reducible. 
We have already seen form Theorem [1 that the case where A has zero diagonal 
entries can be reduced to the case where A has no zero diagonal entries, and we 
know from Lemma [T] that the minimal nonnegetive solution of the reduced equation 
can be found by a simple fixed-point iteration. However, some othe fixed-point 
iterations discribed in [10] may not be well-defined when the matrix I ®A-\- ® I 
is a singular M-matrix, where ® is the Kronecker product, even if all diagonal 
entries of A and D are positive. We now assume that the matrix H in (fTO|) has 
a simple zero eigenvalue. Recall that zero is a simple eigenvalue of H if and only 
if u\vi ^ m|'w2 for the vectors ui,U2,vi,V2 in (|18l) . We then know from Theorem 
[To] that the matrix I (g) {A - $C) + {D ~ C$)^ ® / is a nonsingular Af-matrix. It 
follows that the matrix I ® A-\- (g) / is also a nonsingular M-matrix. 



The class of fixed-point iterations discussed in pjQJ can then be applied to find 

the minimal nonnegative solution $. The theoretical results in [10] (Theorems 2.3, 
2.4, 2.5, 2.7) are all applicable. The convergence of these fixed-point iterations is 
linear. 

Since zero is a simple eigenvalue of iJ, we have A„ > An+i in Theorem [6] and the 
minimal nonnegative solution $ can be computed by finding the invarant subspace 
of H corresponding to the eigenvalues Ai, A2, . . . , A„ using the Schur method, as in 
[10] . When the matrix K is such that Ke — 0, as in the study of Markov chains, the 
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eigenvector corresponding to the zero eigenvalue is known exactly and the modified 
Schur method discribed in [12] can be used to find $ with much better accuracy 
when A„ « A„+i. 

The minimal nonnegative solution $ can also be found by Newton's method. 
Indeed, Theorem 2.3 of 14 is still valid. In [14], I ^ A + / is a nonsingular 
M-matrix because K is a. nonsingular M-matrix or an irreducible singualr M- 
matrix. Here, I ® A + ® I \s a. nonsingular M-matrix because we assume that 
zero is a simple zero eigenvalue of H . The proof of |14, Theorem 2.3] for the 
case where if is a nonsingular M-matrix is valid for the current situation since 
I ® {A — $C) + {D — (g) / is a nonsingular A/-matrix by our assumption on 

H . The convergence of Newton's method is quadratic. 

A structure-preserving doubling algorithm (SDA) has been presented in |17j 
to find the minimal nonnegative solutions $ and ^ simultaneously when if is a 
nonsingular Af-matrx. It is easy to see that the main results in 17 (Theorems 3.1 
and 4.1) still hold when _ftr is a regular singular Af-matrix. One would only need to 
modify some statements in their proofs. Specifically, we now have that the matrices 
R = D — C$ and S = A — B'^ are regular M-matrices (so all eigenvalues of R and S 
are in C>), the matrices D and A are regular M-matrices, and p{R-y) < 1, piSj) < 1 
for all 7 > 0, where Rj = {R + ■^In)~'^{R - 7/„) and Sj = {S + ^1^) {S - ■yl,n). 
The SDA in [T7] generates four sequences {Ek}, {Fk}, {Gk}, {Hk} and 17, Theorem 
4.1] implies that 

(25) limsup < p{R^)p{S^), limsup ^Vll^fc - *|| < p{Ry)p{Sj) 

fc— >oo A:— )-oo 

for 7 > maxjmaxflii, maxdii}. 

The SDA of [17] is further studied in [T5|. When K is an irreducible singular 
M-matrix, it is shown in [15] that the SDA is well defined and (|25]) holds for 
7 > maxjmax Cii, max dii}. Moreover, among these 7 values, the SDA will have 
fastest convergence for 7 = max{max Oii, max dii}. The proof in [15) is based on 
the fact that < < < iJfe < and p{GkHk) < p{^^) < 1. When if is a 
nonsingular M-matrix, we can reach the same conclusion about the SDA since we 
now have < < *, < ii^ < $, and p{GkHk) < p(*$) < 1. 

When if is a reducible singular Ai-matrix and H has a simple zero eigenvalue, 
we know (from LemmajS] Theorem [TU] and Corollary[7]) that one of p{Rj) and p{S^) 
is equal to 1 and the other is strictly smaller than 1. It follows that Hk — )> $ and 
Gfc — 4', both quadratically. We can allow 7 = max{max a^i, max dii} if we have 
p($5') < 1. Note that this special 7 value is positive since K can have at most one 
zero diagonal entry when H has a simple zero eigenvalue. Note also that we do 
have p($^) < 1 if Conjecture [H] is true. 

A negative answer to Conjecture [12] is also interesting. Suppose we can find an 
example with p($^) = 1 when if is a reducible singular M-matrix and H has a 
simple zero eigenvalue. Then for this example, the matrices to be inverted in each 
step of the SDA, I^ — GkHk and Im—HkGk, will be nearly singular near convergence. 
As a result, we would encounter numerical difficulities with the SDA even though it 
has quadratic convergence in exact arithmetic. Moreover, the SDA would also run 
into difficulties for nonsingular Ai -matrices or irreducible singular M-matrices that 
are close to this particular reducible singular M-matrix. Should these situations 
occur, one would be forced to use Newton's method, whose computational work is 
roughly 3 times that for the SDA in each iteration. 
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In the SDA of [17\ . the parameter 7 is used m a Cayley transform apphed to 
the matrix H. In |22) . a generahzed Cayley transform involving two parameters 
a and /3 is applied to H, and the resulting doubling algorithm is called ADDA. 
The iteration formulas in the ADDA are exactly the same as in 17; , but the initial 
matrices Eo,Fo,Go,Ho for ADDA (Go and Hq are denoted by Yq and Xq in [22] ) 
are determined by 

Eq -Go 1 _ \ D + aIn -C 1 [ Z? - /3/„ -C 
-Ho Fo ^ B -A- 131^ B -A + al^ 



(26) 



D 



- ain 
B 



A 



-C 
+ I3I„ 



D - pin 

-B 



A 



al„ 



The above compact form for determining Eo, Fq,Gq, Ho is based on a result of 
Poloni jl9j (see also [41 Theorem 5.5]). It is easy (but tedious) to verify directly that 
these initial matrices are the same as those determined in 22 . When a = /? = 7, 
the ADDA is reduced to the SDA and the initial matrices Eq, Fo,Go, Ho from (pS)) 
are exactly the same as those in ^17^. 

When K is a nonsingular M-matrix or an irreducible singular Af-matrix, the 
convergence theory of the ADDA has been given in [22]. The following result 
allows K to be singular and reducible. 

Theorem 15. Let K be a regular singular M-matrix and assume that a > maxau 
and (3 > maxdi^. Then the ADDA is well defined with I~GkHk and I—H^Gu being 
nonsingular M -matrices for each fc > 0. Moreover, Eq <^,Fo< 0, E^ > 0, F^ > 0, 
< Hk-i < Hk < < Gk-i < Gfe < * for all k>l, and 



limsup Vll^fe-*ll < r{a,l3), limsup Vl|Gfe - *|| < r(a,/3), 

where r{a, l3) p{{R + aI)-^{R~ pi)) ■ p {{S + (31)-^ {S - al)) with R = D - 
C<i>,S = A- B^. 

Proof. The proof is largely the same as in |22| . The main difference is that the ap- 
proach in [15j cannot be used to prove that I — GkHk and I ~ H^Gk are nonsingular 
M- matrices for each fc > 0. Instead, this property is proved using the approach in 
|17) , which does not allow a = max an or /3 = max da . □ 

When H has a simple zero eigenvalue, we know from Lemma [H Theorem [TOl 
and Corollary [7] that one of the matrices R and 5* is singular and the other is 
nonsingular. It follows from [22l Theorem 2.3] that r(a,/3) < 1 in Theorem [T5] 
Thus, Hk converges to $ quadratically, and Gk converges to ^ quadratically. Since 
K has at most one zero diagonal entry when H has a simple zero eigenvalue, we 
have maxoii > and maxd^i > when m,n > 2 (which we shall assume). By 
|22i Theorem 2.3] r(a, /3) is strictly increasing in a for a > maxau, and is strictly 
increasing in /3 for /3 > maxd^^. If Conjecture [12] is true, then p($^') < 1 when H 
has a simple zero eigenvlaue. In this case we can use the approach in |15] to prove 
that the ADDA is well defined with / — GkHk and / — HkGk being nonsingular 
M- matrices for each fc > even when a = max a^i and /3 = maxd^i. Therefore, if 
Conjecture [12] is true, we should normally use the optimal values a = maxa^ and 
P = max da for the ADDA. Otherwise, we may have to take a and /? to be slightly 
larger. When maxa^ is much larger (or smaller) than maxd^i, the convergence of 
ADDA may be significantly faster than that of the SDA in [17], it is also faster 
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than the SDA-ss m ^5,. When maxaii w max da but max an 3> niinaii and/or 
max da ^ mm da , all three doubling algorithms take roughly the same number of 
iterations for convergence, which may be significantly larger than that required for 
the Newton iteration, as noted in [13 . 

We also remark that the modified Schur method described earlier can achieve 
very good normwise accuracy, but this method is unable to compute any tiny posi- 
tive entries in the minimal nonnegative solution with good relative accuracy, while 
the fixed-point iterations, the Newton iteration, the doubling algorithms can be 
implemented in such a way that these tiny positive entries can be computed with 
high relative accuracy [23] . 

5. Some illustrating examples 

When the matrix X in ([2|) is a regular Af-matrix that is singular and reducible 
and the matrix H in (|10|) has a simple zero eigenvalue, the numerical algorithms 
reviewed in the previous section can be applied without difficulty (with the help 
of our new theoretical results) and the numerical behaviour of these algorithms is 
very similar to that for the equation ([ij corresponding to a nearby nonsingular 
M-matrix or irreducible singular M-matrix. So in this section, we only present a 
few examples of small sizes to illustrate some of the theoretical results established 
in this paper. 

Take 

"2-1-1 " 



0-1-1 2 

Then if is a regular Af-matrix that is singular and reducible, with Ke — 0. The 
2x2 matrices A,B,C,D are then determined by ([2]). We find that the eigenvalues 
of H are 2,1,0,-3. By Theorem [6] the minimal nonnegative solution $ of ([T]) is 
determined by the eigenvectors corresponding to the eigenvalues 2 and 1, and is 
found to be 

"0 1/2 " 
1/2 ■ 

As shown in Lenima[9]and Theorem [10] (ii) , $ is substochastic. 
We now take 



2 


-1 





-1 


-1 


2 





-1 








2 


-2 


-1 


-1 





2 



Then if is a regular Ai-matrix that is singular and reducible, with Ke — 0. The 
2x2 matrices A,B,C,D are again determined by ([2]). We find that the eigenvalues 
of H are 3, 0, —1, —2. The minimal nonnegative solution $ of (H]) is determined by 
the eigenvectors corresponding to the eigenvalues 3 and 0, and is found to be 

" 1/2 1/2 " 
1/2 1/2 ■ 

As shown in Theorem [TOl (i), $ is stochastic. By Proposition [T4l the equation ([1]) 
has at most two positive solutions. For this example, ([T]) has exactly two positive 
solutions. As suggested by [6j Lemma 11], the other positive solution of H]) is 
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determined by the eigenvectors corresponding to the eigenvalues 3 and —1, and is 
found to be 

"2 2 " 
1 1 ■ 

For this example, PropositionfTSlalso applies, and we know that I — ^'i and / — 4'$ 
are nonsingular Af-matrices. 
Finally we take 

"1 -1 " 



_ -1 1 _ 

Then K is a regular Af-niatrix that is singular and reducible, with Ke = 0. The 
2x2 matrices A, B,C,D are again determined by ©. We find that the eigenvalues 
of H are 1,0,0,-1 and that there is only one linearly independent eigenvector 
corresponding to the double eigenvalue 0. The minimal nonnegative solution of ^ 
is determined by the eigenvectors corresponding to the eigenvalues 1 and 0, and is 
found to be 

"0 1 " 

1 ■ 

It is easy to verify that this is the only nonnegative solution of ([T]). For this example, 
we have case (iii) in Theorem [TOl and $ is stochastic. 



6. Conclusions 

In this paper we have studied algebraic Riccati equations associated with regular 
M-matrices. Our results extend previous results for algebraic Riccati equations 
associated with nonsingular M-matrices or irreducible singular M-matrices. In the 
future, we can use the term M-matrix algebraic Riccati equation to refer to equation 
Q for which the matrix iiT in ([2]) is a regular Af-matrix. While we have been able 
to prove a number of theoretical results for this larger class of Riccati equations 
(sometimes with proofs simpler than previous proofs for special cases; see proof of 
Theorem |6] for example), we are unable to prove the statement given in Conjecture 
[T2] We have pointed out that an answer to the conjecture (whether it is positive 
or negative) has interesting implications. Some further research is needed to settle 
this conjecture. 
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